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Background 

This present invention relates to the recording and 
playing back of an audio stream. An audio stream includes 

10 any combination of audio and/or audio data streams. 

Audio streams have typically been recorded on analog 
media such as a cassette recorder. The audio stream may 
come via a broadcast signal, via cable, via satellite 
signal, or from another playback device. Once the audio 

15 stream has been recorded, the recorder is used to rewind 
the recording medium and play what was recorded. However, 
due to the nature of the analog medium, once the recorder 
has started recording, it is not possible to play back the 
portion of the audio stream that has already been recorded 

20 until the recording session is terminated. 

Thus, there is a need for an improved way of recording 
portions of audio transmissions. 
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Brief Description of the Drawings 
Figure 1 is a block diagram of a record and playback 
system in accordance with one embodiment of the invention; 
Figure 2 is a flow chart of one embodiment of the 
5 method of providing a time- shifted stream in accordance 
with the invention; 

Figure 3 shows one embodiment of performing block 2 06 
of Figure 2 ; 

Figure 4 shows one embodiment of an apparatus for 
10 storing the stream on a hard disk in accordance with the 
invention; 

Figure 5 shows an embodiment of a method of using the 
storage unit as a temporary buffer in accordance with the 
invention; 

15 Figure 6 is a flow chart of the playback of a audio 

stream catching up to the incoming audio stream for one 
embodiment of the invention; 

Figure 7 shows another embodiment, in which the user 
is able to suspend the display of the incoming audio stream 
20 in accordance with the invention; 

Figure 8 is a flow chart showing one embodiment of a 
system for recording and playing back a audio stream in 
accordance with the invention; 

Figure 9 is a block diagram of a computer system 
25 useful in implementing one embodiment of the present 
invention; 



Figure 10 is a flow chart showing the operation of 
another embodiment of the present invention; 

Figure 11 is a block diagram showing how data is 
transferred to and from a memory device in accordance with 
5 one embodiment of the present invention; 

Figure 12 is a flow chart showing the flow of input 
audio information into a storage device in accordance with 
one embodiment of the present invention; and 

Figure 13 is a flow chart showing the flow of data 
10 from the storage device in accordance with one embodiment 
of the present invention. 

Detailed Description 
Figure 1 shows a block diagram of a audio record and 
playback system 100 in accordance with one embodiment of 

15 the invention. A audio stream is received at the audio 
input port 102. The audio stream may be provided by a 
radio broadcast, cable, or satellite signals, or another 
audio playback device. In one embodiment, an analog-to- 
digital conversion may be performed on an analog audio 

20 stream to form a digital audio bit stream. In a different 
embodiment, the audio is already in digital form. The 
audio record and playback system 100 may be part of a 
system, such as a computer system or set top box, such that 
the audio input port 102 may be part of a audio capture 

25 card in the computer system or set top box. 
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The digital audio stream from the audio input port 102 
is optionally compressed at compression unit 104. In one 
embodiment, the audio is already compressed and no further 
compression is needed. The audio stream is then stored in 
5 the storage unit 108. A buffer unit 10S may be used as 

temporary storage for providing larger sequential blocks of 
audio data to the storage unit 10 8. In one embodiment, the 
buffer unit 106 comprises a random access memory that 
allows relatively quick access to any portion of the stored 

10 audio stream. 

The audio stream is played back by reading the audio 
stream from the storage unit 108. If the audio stream was 
compressed in compression unit 104, then a decompression 
unit 110 decompresses the retrieved audio stream. The 

15 audio stream is provided from a audio output port 120, to a 
monitor or other display device such as a TV to provide 
sound and/or audio to a user. 

A removable storage unit 122 may also be included in 
audio record and playback system 100, Examples of removable 

2 0 storage units include a writeable compact disk read only 

memory (CD-ROM) , writeable digital audio disk (DVD) , a flash 
memory, or another hard disk. The availability of a 
removable storage unit 122 allows a user to transfer a 
recording of a audio stream stored in storage unit 108 to 

25 the removable storage unit 122 and then to transfer the unit 
122 to another system at a different location. 
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In one embodiment, a processor 13 0 controls the 
operations of the audio record and playback system 100. 
The compression unit 104 and decompression unit 110 may be 
implemented in hardware, or the compression and 
5 decompression functions of units 104 and 110 may be 

performed by the processor 130. Processor 130 receives 
instructions from firmware /memory 110, using technology 
that is well known. 

Figure 2 shows a flow chart of an embodiment of a 

10 method of providing a time-shifted audio stream in 

accordance with the present invention. The flow chart 
begins at block 200, and continues at block 202 where the 
audio stream is received. The recording of the audio 
stream begins at block 204. At block 206, playback of the 

15 recorded audio stream is performed by retrieving a portion 
of the audio stream from the random access storage unit 
while the recording of the incoming audio stream continues. 
The retrieved portion of the audio stream may be time- 
shifted from the incoming audio stream by a time delay. At 

20 block 208, the portion of the audio stream retrieved from 
the random access storage unit is retrieved for playback. 

In this way, the record and playback functions are 
decoupled from one another. The user may now begin 
listening to recorded music from the beginning, e.g., prior 

25 to the music being completely recorded. 
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Figure 3 shows an embodiment of a method for 
retrieving a portion of the audio stream from the random 
access storage unit while continuing to record the incoming 
audio stream in accordance with the invention, although the 
5 invention is not restricted to this embodiment. In the 
disclosed embodiment, the substantially simultaneous 
recording and playback of the audio stream is performed by 
multiplexing or alternately storing the audio stream to the 
random access storage unit and reading of the audio stream 

10 from the random access storage unit. The multiplexed or 
alternated stores and reads may occur quickly enough that 
the user does not notice an appreciable delay in the 
playback of the audio stream, and the incoming audio stream 
is not lost, e.g., all of the audio stream is recorded. 

15 Thus, the record and playback are substantially 
simultaneous from the user's point of view. 

In one embodiment, the random access storage unit 
comprises a hard disk. The retrieval of the time-shifted 
audio signal from the hard disk is performed at a first 

20 physical location (or sector) of the hard disk, and the 
storing to the hard disk of the incoming audio stream is 
performed at a different physical location (or sector) on 
the hard disk. Because it takes more time to jump back and 
forth between different sectors of the hard disk than to 

25 read and write to sequential locations in the same sector, 
data may be buffered to reduce the number of accesses to 
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and from the hard disk using buffer 106. This increases 

the amount of data transferred per access. 

Additionally, because of time constraints for reading 

and writing to the hard disk, data may be compressed and 
5 decompressed to speed transfers to and from the hard disk. 

In block 302, the audio stream is stored in a random 

access storage unit. The audio stream is optionally 

compressed and/or buffered prior to storage. In block 3 04, 

the audio stream is retrieved from the random access 
10 storage unit. Buffering and/or decompression may be 

performed before providing the retrieved audio stream to 

the audio output port 120. 

The next portion of the audio stream is stored (block 

306) as described in block 302. At block 308, the next 
15 portion of the audio stream is retrieved as described in 

block 3 04. This process is repeated until either the 

recording or playback cycle is terminated. 

Figure 4 shows one embodiment of an apparatus for 

storing the audio stream in the storage unit 108 in 
2 0 accordance with the invention. Again, the invention is not 

restricted in scope to the illustrated embodiments. In this 

embodiment, the audio stream is stored as separate files 001 

and 009 on a hard disk, for example. The processor 13 0 

keeps track of the file and offset into the file of the data 
25 being played back, as well as the file and offset into the 

file of the data being recorded. If the random access 
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storage unit is fast enough, more than one audio stream may 
be recorded and played back at the same time. 

Due to the nature of the random access storage unit 
being capable of easily recording over itself, the random 
5 access storage unit may act as a temporary buffer for 

recording the latest portion, or X number of minutes, of an 
incoming audio stream, where X is set up based upon the 
size of the storage unit in this particular embodiment. In 
one embodiment, X could be set up to be the entire storage 

10 unit. As newer portions of the audio stream are received, 
they overwrite the older portions of the audio stream saved 
in the random access storage unit. In this manner, the 
temporary buffering of the audio stream acts as a circular 
buffer. In one embodiment, the processor 13 0 maintains 

15 pointers to the beginning and ending points of the 

temporary buffer. The processor 13 0 reassigns the pointers 
as newer portions of the audio stream are received and/or 
older portions of the audio stream are overwritten. 

Figure 5 shows a flow chart 500 of an embodiment of 

20 one method for using a temporary buffer in accordance with 
the invention. At block 5 02, the audio stream is received 
at an input. Recording of the audio stream to the storage 
unit begins at block 504. At block 506, older portions of 
the audio stream are deleted as newer portions of the audio 

25 stream are stored to the storage unit. 
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A user may initiate a playback cycle following block 
506. For example, this may occur when the user wishes to 
replay an audio clip that he just listened to. In one 
embodiment, the user stops recording to the temporary 
5 buffer and plays back the last portion of the temporary 
buffer . 

However, it may be more desirable to the user to be 
able to continue recording as shown at block 508. A record 
and playback cycle (as described with respect to Figure 2) 

10 is started, in which the incoming audio stream is recorded 
while the user replays the last portion of the temporary 
buffer. In this manner, after replaying the desired audio 
clip, the user can resume sequentially listening to the 
audio stream from the current point of the incoming audio 

15 for substantially simultaneous playback and record. 

At block 510, after the record and playback cycle is 
completed, all or part of the temporary buffer may be saved. 
Since the temporary buffer stores the latest X minutes of 
the audio stream prior to the record and playback cycle, all 

20 or part of the temporary buffer may be allocated to the 
portion of the audio stream saved during the record and 
playback cycle. Other portions of the audio stream may then 
be deleted from the storage unit, or they may be marked as 
overwriteable and used as a new temporary buffer. 

25 Figure 6 illustrates an embodiment of a method for 

playing back a audio stream to allow the playback to catch 
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up to the incoming audio stream in accordance with the 
invention. If the playback is performed at an overall rate 
faster than the rate at which the incoming audio stream is 
received, then the playback may catch up to the incoming 
5 audio stream. 

For example, playback of the audio stream may have an 
overall rate faster than the rate of the incoming audio 
stream if the playback is fast forwarded, or if segments of 
the playback are skipped altogether. When the time delay 

10 of the time-shifted audio stream being played back falls 
below a certain threshold, the audio playback system 100 
will cease providing the time-shifted audio stream from the 
storage unit. Instead, the incoming audio stream will be 
provided to the audio output port 12 0 directly. In one 

15 embodiment, a bypass 142, as shown in Figure 1, allows the 
incoming audio stream to be provided to the audio output 
port 120 directly. 

When this happens, the user has caught up to the 
"live" broadcast, e.g., the incoming audio stream in this 

20 embodiment. The user may terminate the recording cycle, if 
he wishes. Alternatively, the user may put the audio 
record and playback system 100 back into the temporary 
buffering mode in which only the latest portion of the 
audio stream is stored. 

2 5 Figure 7 shows an embodiment in which the user is able 

to suspend the play of the incoming audio stream. This can 
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be used for example, when the user is interrupted, and 
wishes to continue listening to the audio stream after the 
interruption. When interrupted, the user signals to the 
audio stream and playback system 100 to suspend the play of 
5 incoming audio stream. This can be done via a remote 
control, for example. At block 702, the audio output 
signal is suspended. 

At block 704 the incoming audio stream is recorded but 
is not played. Instead the playback is paused at the point 

10 at which the user indicated that the incoming audio stream 
be suspended. When the user is ready to listen to the 
audio stream again, he or she can signal the audio record 
and playback system 100 to un-suspend the audio stream so 
that it plays back from the point at which the audio stream 

15 was suspended, as shown in block 706. 

The user may then listen to the audio stream time 
shifted by the amount of time that he suspended the 
incoming audio stream, or he may fast forward (or rewind) 
through the time-shifted audio stream. When playback of 

20 the time-shifted audio stream catches up to the point at 
which the incoming audio stream is being recorded, the 
record and playback system 100 may display the incoming 
audio stream directly from incoming audio stream without 
retrieving the audio stream from the storage unit, as 

25 described with respect to Figure 6. The recording of the 
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audio stream may then be terminated by the user, if 
desired. 

Referring now to the embodiment shown in Figure 8, a 
flow chart 800 for digitally recording a audio stream in 
5 accordance with an embodiment of the invention begins by 
capturing the audio stream as indicated in block 802. If 
the stream is an analog stream, it may be digitized in an 
analog-to-digital conversion process as indicated at block 
804. Next, the digital stream may be encoded and 

10 compressed, as indicated in block 806. The stream is 

alternately read, as indicated at block 810, and stored, as 
indicated in block 808, in a conventional storage device 
such as a hard disk drive, a digital audio disk or a flash 
memory. Data that is read from the storage device may be 

15 decoded and decompressed using conventional technology, for 
example, as indicated in block 812, for display as indicated 
in block 814. 

A system 900 in accordance with one embodiment of the 
present invention, shown in Figure 9, includes a processor 

20 902. In one embodiment, the processor may be coupled to an 
accelerated graphics port (AGP) chipset 904 for 
implementing an accelerated graphics port embodiment. The 
chipset 904 communicates with the AGP port 905 and the 
graphics accelerator 906. The television 910 may be 

25 coupled to the audio output of the graphics accelerator 
906. The chipset 904 accommodates the system memory 908. 
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The chipset 904 is also coupled to a bus 912 which may be, 
for example, a peripheral component interconnect (PCI) bus 
(PCI Local Bus Specification, Version 2,1 June 1, 1995). 
The bus 912 couples to tuner card 914 which is coupled to 
5 an antenna 915 or other audio input port, such as a radio 
input port, a satellite receiver/antenna or the like. The 
tuner card 914 selects a desired radio channel and also 
performs the audio capture function (block 8 02, Figure 8) . 
The bus 912 is also coupled to a bridge 916 which 

10 couples a hard disk drive 918. The software 200, 300, 500, 
600, 700, 800, 1000, 1200 and 1300 may be stored on the 
hard disk 918. The bridge 916 is also coupled to another 
bus 932, The bus 932 may be coupled to a serial 
input/output (SIO) device 934. The device 934 is in turn 

15 coupled to conventional components such as a mouse 93 6 and 
a keyboard 938. Also coupled to the bus 932 is a basic 
input/output system (BIOS) 942. 

The consolidated replay software 1000, shown in Figure 
10, monitors for one of a plurality of user feature 

20 selections, in one embodiment. A query is made at diamond 
1012 to determine whether a pause function has been 
selected. If so, the playback is stopped as indicated at 
block 1014 but recording continues unabated as shown in 
block 1016. 

25 The next check determines whether the play feature has 

been selected (block 1018) . If so the recorded content is 
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played thereby terminating the paused display. However, 
while the recorded content is played, recording continues 
as indicated in block 1022 so that the recorded content may 
be eventually played without disrupting the continuity of 
5 the playback. 

A query finds out if the fast forward feature has been 
implemented as indicated in diamond 1024. If so, a fast 
playback is implemented as shown in block 1026. Once the 
playback equals the current broadcast or program content 

10 (diamond 1028), the flow returns to play current content. 
The fast forward may progress at faster than normal 
playback speed. 

At diamond 103 0 a check is done to see if the 10 
second replay feature has been activated. If so, the 

15 storage device is operated to find the content which was 

recorded 10 seconds ago (block 1032) . The recorded content 
is then played (block 1034) from the 10 second period back 
to present. After the "rewind" and playback of 10 seconds 
has been completed, the system is automatically transferred 

2 0 to automatic play at the content that was recorded while 

the replay is being displayed so the user does not lose any 
continuity. Of course, the user can set the amount of time 
for the replay to be something other than 10 seconds. 

A catchup feature is checked (diamond 1036) and, if 

25 this feature has been selected, an accelerated playback 

option is implemented (as indicated in block 1038) . In the 
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accelerated playback, the playback may be slightly 
increased in speed so the user can easily follow a program 
but can make up for lost time to get back into the program 
as broadcast . Once the recorded program catches up to the 
5 real-time program as indicated in diamond 1040, the catchup 
feature is completed and the user returns to real-time 
display. A conventional technique may be used to maintain 
audio pitch during accelerated playback. 

Techniques for storing the audio stream onto the 

10 storage device 918 and for reading the information out of 
the storage device are summarized in Table 1 below and 
illustrated in Figures 11, 12, and 13. In Figure 11, a 
schematic depiction of the storage system 1100 includes a 
digital storage device such as a hard disk drive 918. The 

15 digitized audio 1102 is initially stored in a buffer which 
is designated as being currently on the top of the memory 
stack. The transfer of information between the buffers and 
the storage device 1110 may be done in discrete time 
periods referred to herein as time steps. 











Time 


Steps 








Buffers 


2 


3 


4 


5 


6 


7 


8 


9 


Input 


1108 


1106 


1104 


1108 


1106 


1104 


1108 


1106 


Storage 


















Read 


X 


X 


1112 


X 


1114 


X 


1112 


X 








1114 




1116 




1116 




Write 


X 


1104 


X 


1104 
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X 


X 


1114 
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1116 


1114 


1112 



20 

Table 1 (X = no action) 
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In a first time step, shown in Figure 12, the 
digitized audio 1102 (Figure 11) is stored in memory buffer 
1104 because that buffer is currently at the top of the 
memory stack, as indicated in block 1202 in Figure 12. 
5 As the buffer 1104 fills up, the buffer 1108 moves to 

the top of the stack (as indicated by the dashed arrow) and 
incoming audio is stored in buffer 1108. As indicated in 
block 1204 in Figure 12 in time step 2, the buffer 1108 
replaces the buffer 1104 as the designated top of the stack 

10 buffer. The next input audio is then stored in the new 
buffer (1108) as indicated in block 1206. 

In time step 3 the buffer 1108 has filled up and the 
contents of buffers 1104 and 1108 are written to the storage 
device 1110 in a single write operation. During the same 

15 time step, buffer 1106 moves to the top of the stack and 
becomes the storage buffer for incoming audio. This is 
illustrated in blocks 1208, 1210 and 1212 in Figure 12. 

In time step 4, the buffer 1104 moves back to the top 
of the stack to store incoming audio since its previous 

2 0 content has already been saved in the storage device 1110. 
This is indicated in block 1214 of Figure 12. Additionally, 
in time step 4, the content of buffer 1108 is written to the 
storage device 1110 as illustrated in block 1215. The 
storing of incoming information, as illustrated in Figure 12 

25 then cycles back to the top of the flow in Figure 12 and 
continues in the same fashion thereafter. 
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The content from the storage device 1110 is then read 
into buffers 1112 and 1114 in time step 4 and block 1302. 

In time step 5, the buffer 1108 moves to the top of 
the stack to store incoming audio, and buffer 1114 moves to 
5 the top of the output stack and transfers data to the audio 
output 1118. The contents of the buffers 1104 and 1106 are 
then written to the storage device 1110. 

The time steps 1 to 5 illustrate a complete cycle from 
input to output. The remaining sequence of steps repeat 
10 starting at step 1 through 4 for the input of data and time 
steps 4 through 9 repeat for the output of data. 

Referring now solely to Figures 11 and 13, in time 
step 6, information stored in the storage device is read to 
the sixth and fourth buffers (i.e., buffers 1114 and 1116) 
15 as indicated in block 1306. The contents of the fifth 
buffer (1112) are sent to the output port 1118. 

In time step 7, the contents of the sixth buffer 
(which is buffer 1116) are sent to the output port 1118. 
No other output operations occur. 
20 In time step 8, the contents from the storage device 

1110 are read into the fifth and sixth buffers (buffers 
1112 and 1116) as indicated in block 1312. Also the 
contents of the fourth buffer (buffer 1114) are passed to 
the output port 1118 as indicated in block 1314. 
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Finally, during time step 9 the contents of the fifth 
buffer (buffer 1112) are passed to the output port 1118, 
completing the cycle. 

Using these techniques, the storage device is provided 
5 with enough time, through the operation of the buffers, to 
write the incoming audio while supplying enough data 
simultaneously to the output display. Since the memory is 
used to make sure no content is dropped at the input end 
and the display is never starved at the output end, 

10 continuous display can be provided without losing 

information. In addition reading and writing larger chunks 
of data at one time reduces the amount of storage device 
head movement, thereby allowing the storage device to keep 
up with the read and write requests. 

15 The size of the individual buffers 1104 to 1108 and 

1112 to 1116 ("B") in megabytes is dependent at least in 
part on a number of factors including the input/output data 
rate "D" , for example in megabytes per second, the 
effective bandwidth of the storage device when reading or 

20 writing W S", for example in megabytes per second, and the 
average seek time for the storage device per transaction 
w t", in microseconds. The time that it takes to fill up 
one memory buffer (B divided by D) is advantageously 
greater than the time it takes to read or write two memory 

25 buffers (2B divided by S) plus the average seek time (t) : 
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